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1  Objectives 

The  objectives  of  AFOSR  grant  no.  FA9550-06- 1-0096  arc  as  follows: 

1.  Integrate  probabilistic  model  building  and  evaluation  relaxation. 

2.  Integrate  probabilistic  model  building  and  time  coiitiiiuation. 

3.  Integrate  probabilistic  model  building  and  local  search  procedures. 

4.  Integrate  probabilistic  model  building  and  parallel  evaluation. 

5.  Combine  the  above  sources  of  snpcrmultiplicativc  speedup  to  investigate  upper  limits  of  in¬ 
tegrated  offi(  ic'iK'y  enhancement. 

6.  Extend  facctwise  and  little  models  to  predict  integrated  solution  quality  and  speedup. 

7.  Demonstrate  speedups  using  the  developed  procedures  in  two  prol)lcm  areas  of  Air  Voycv 
interest. 

Sigiiificaut  progress  has  been  made  on  each  goal.  The  progress  is  l)riefly  reviewed  in  tlu'  next 
section. 
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2  Status  of  Effort 


Efficient  genetic  algorithm  optimizes  problems  with  over  billion  variables.  An  (  fficic  iit , 
fully  parallelized  genetic  algorithms  was  implemented  to  achieve  efficient,  scalable  solutions  on 
difficult  optimization  problems  containing  over  a  billion  variables.  The  results  demonstrated 
sealable  solution  of  a  diffieult  test  function — a  noisy,  blind  problem  over  a  vector  of  binary 
decision  variables — on  instances  over  a  billion  variables  using  a  specially  programmed  parallel 
genetic  algorithm.  The  GA  is  able  to  find  the  optimum  in  the  presence  of  noise  quickly,  reli¬ 
ably,  and  accurately,  and  the  solution  scalability  follows  known  convergence  theories.  These 
results  on  noisy  problem  together  with  other  results  on  problems  involving  varying  modular¬ 
ity,  hierarchy,  and  overlap  foreshadow  routine  solution  of  billion- variable  problems  across  the' 
landscape  of  complex  systems. 

Efficiency  enhancement  from  sporadic  model  building.  Sporadic  model  building  w^is  pro¬ 
posed  to  speed  up  model  building  in  the  hierarchical  Bayesian  optimization  algorithm  and 
other  advanced  estimation  of  distribution  algorithms.  The  proposed  technique  led  to  signifi¬ 
cant  speedup  of  the  algorithm  without  sacrificing  solution  quality  or  reliability.  The  spoeduj^s 
grow  with  problem  size  and,  thus,  the  bigger  the  problem,  the  higher  speedups  can  bo  ob- 
taiiu'd.  For  difficult  problems,  speedups  of  at  least  one  order  of  magnitude  can  be  expec  ted. 
Theoretical  model  was  developed  and  verified  to  provide  a  robust  approach  to  setting  the 
paraiiict('rs  of  sporadic  model  building. 

Evaluation  relaxation  for  interactive  GAs  invented.  One  of  the  bottlenecks  of  interactive 
GAs — where  users  evaluate  the  relative  quality  of  candidate  solutions — is  user  fatigue.  A 
principled  method  for  eliminating  user  fatigue  was  invented  and  significant  speedups  wert' 
reported.  In  essence,  the  method  relics  on  a  surrogate  induced  from  a  partial  ordered  gra[)h 
of  user  preferences.  The  surrogate  is  used  for  optimization  to  partially  replace  expensive  user 
evaluations. 

Evaluation  relaxation  used  to  speedup  machine  learning.  Tight  integration  of  surrogate 
and  structural  models  were  carried  over  to  genetics  based  machine  learning.  Specifically, 
evaluation  relaxation  scheme  was  used  to  alleviate  the  computational  cost  of  evaluating  fit¬ 
ness  of  a  rule  against  large  data  sets.  First  results  indicate  that  the  fitness  estimates  of  rh(' 
surrogates  arc  of  high-quality  and  the  computational  cost  is  significantly  lower  than  the  tru(‘ 
fitness  evaluations.  These  initial  results  strongly  suggest  possibilities  of  super- multii)licative 
speedups  in  genetics-based  machine  learning  domain  as  well. 

7  orders  of  magnitude  speedup  in  reaction  chemistry  simulations.  We  (Todd  Martinez 
(2005  Mac  Arthur  fellow),  Duane  Johnson,  Kumara  Sastry  and  David  E.  Goldberg)  have 
applied  iiiultiobjcctivc  GAs  and  model  building  to  enable  fast  and  accurate  quantum  rc'ac- 
tion  cliciuistry  simulations.  This  work  is  providing  fresh  insights  and  important  research 
avenues  toward  fast,  accurate  chemistry  calculations  which  will  dramatically  accelerate  both 
the  science  (biophysical  basis  of  vision,  air  pollution,  and  photosynthesis)  and  synthesis  of 
new  pharmaceuticals,  chemicals  and  materials. 

9  orders  of  magnitude  speedup  in  materials  modeling.  We  (Duane  Johnson,  Pascal  Belloii, 
Kumara  Sastry,  and  David  E.  Goldberg)  have  applied  genetic  programming  to  multi-scale 
modeling  of  alloys  using  a  hybrid  of  the  molecular  dynamics  (MD)  and  kinetic  Monte  Carlo 
(KMC)  procedures.  In  2D  surface  modeling  our  calculations  project  speedups  of  9  orders  of 
magnitude  at  300  degrees  Kelvin.  Two  papers  have  been  published  (International  Journal  for 
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Multiscalc  Computational  Engineering  and  Physics  Review  B)  and  wcis  chosen  as  a  focused 
article  of  frontier  research  by  the  editors  of  American  Institute  of  Physics.  Simply  stated, 
genetic  programming  is  used  to  perform  customized  statistical  mechanics  by  bridging  tlu' 
different  time  scales  of  MD  and  KMC  quickly  and  well. 

Random  additivcly  decomposable  problems.  A  class  of  additivcly  decomposable  piobleiiis 
was  proposed  to  test  and  analyze  performance  of  optimization  techniques  for  nearly  dccoin- 
posablc  and  hierarchical  problems.  A  method  was  proposed  to  generate  random  instance's  of 
the  proposed  class  of  problems  and  experimental  results  were  obtained  to  confirm  scalability 
theory  and  various  properties  of  simple  and  advanced  evolutionary  algorithms. 

Extended  compact  classifier  system  invented.  The  idea  of  an  estimation  of  distribution  al¬ 
gorithm  has  become  commonplace  in  optimization  problems,  but  these  ideas  have  not  been 
widely  explored  in  machine  learning  applications.  First  results  and  publications  were  prepared 
on  the  extension  of  compact  classifier  system  to  learn  and  discover  interactions  between  at¬ 
tributes  by  datamining  a  population  of  promising  rules. 

Critical  components  for  handling  modularity,  hierarchy,  and  overlap  discovered. 

Techniques  using  dependency  structure  inatriccs  (DSMs)  have  been  used  by  large  corpo¬ 
rations  and  governmental  agencies  in  organizational  design.  Work  on  DSM  clustering  led 
to  the  creation  of  a  GA  called  the  DSMGA  using  DSM  clustering  to  do  building-block 
decomposition.  This  year,  work  on  DSMGA  has  led  to  the  discovery  of  key  components 
required  to  handle  modularity,  hierarchy,  and  overlap  common  ingredients  of  coni])lex 
systems.  The  key  components  for  conquering  modularity,  hierarchy,  and  overlap  inclnde 
accurate  decomposition,  niching,  chunking,  proper  sequencing,  and  well-informed  decision 
making. 

Application  of  genetic  algorithms  to  prediction  from  NIR  Spectra.  An  iinpleinentation 
of  a  genetic  algorithm  was  developed  for  reliable  prediction  of  chemical  properties  from  near- 
infrared  (NIR)  spectra.  From  experimental  data,  a  model  is  constructed  that  both  (1)  fits 
experimental  data  well  and  (2)  generalizes  well  to  unseen  samples.  The  prediction  is  done 
by  a  simple  linear  model  in  combination  with  a  genetic  algorithm  used  to  select  important 
attributes  for  reliable  prediction.  Promising  results  have  been  obtained  on  several  data  sets 
based  on  the  experiments  on  old  documents. 

Structural  analysis  of  flexible  macromolecular  systems.  An  implementation  of  a  genetic'  al¬ 
gorithm  was  developed  for  the  analysis  of  flexible  macromolecular  systems  such  as  intrinsically 
disordered  or  multidomain  proteins  with  flexible  linkers.  Data  obtained  at  the  Lawrence  Liv¬ 
ermore  National  Lab  in  Berkeley  arc  used  as  input  to  a  genetic  algorithm,  which  determines 
subsets  of  theoretical  structures  that  approximate  empirical  results  best.  The  results  arc  then 
analyzed  to  provide  insight  into  the  flexibility  of  the  studied  system.  The  first  results  wore 
tantalizing,  and  the  method  is  currently  being  applied  in  practice. 

Ground  states  of  large  Shcrrington-Kirkpatrick  spin  glasses.  Several  approaches  were  de¬ 
veloped  for  reliable  detection  of  ground  states  of  large  instances  of  the  Shcrrington-Kirkpatrick 
(SK)  spin-glass  model.  To  achieve  this  goal,  hybrid  techniques  were  proposed  that  combine 
advanced  genetic  and  evolutionary  algorithms  with  specialized  local  search.  The  results  should 
be  important  for  both  physicists  as  well  as  practitioners  in  evolutionary  computation.  The 
l>rojcct  was  later  extended  to  the  oiic-diincnsional  SK  spin  glass  with  power-law  interactions. 

Learning  from  experience  in  advanced  estimation  of  distribution  algorithms. 

Estimation  of  distribution  algorithms  (EDAs)  arc  stochastic  optimization  teclmi(ines 
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that  explore  the  spaee  of  potential  solutions  by  building  and  sampling  explieit  probabilistic 
models  of  promising  eandidate  solutions.  While  the  primary  goal  of  applying  EDAs  is  to 
diseover  the  global  optimum  or  at  least  its  aeeuratc  approximation,  besides  this,  any  EDA 
provides  us  with  a  sequenee  of  probabilistie  models,  which  in  most  cases  hold  a  great  deal  of 
information  about  the  problem.  We  proposed  several  approaches  to  enhancing  the  efficiency 
of  EDAs  by  analyzing  information  provided  by  the  sequences  of  models  from  previous  EDA 
runs,  leading  to  substantial  speed-ups  on  future  problem  instances  of  similar  type.  This 
line  of  research  also  led  to  better  understanding  of  the  structure  of  probabilistic  models 
discovered  by  advanced  EDAs,  such  as  the  hierarchical  Bayesian  optimization  algorithm 
(hBOA). 
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Approximation.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference.  1827 
1834  (2005). 

Lanzi,  P.-L.,  D.  Loiaeono,  S.  W.  Wilson,  and  D.  E.  Goldberg,  XCS  with  Computable  Prediction  in 
Multistep  Environments.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Confeivnce 
(GECCO  2005),  1859-1866  (2005). 

Lima,  C.  F.,  K.  Sastry,  D.  E.  Goldberg,  and  F.  G.  Lobo,  Combining  Competent  Crossover  and 
Mutation  Operators:  A  Probabilistie  Model  Building  Approaeh.  Proceedings  of  the  Genetic  and 
Evolutionary  Computation  Conference  (GECCO  2005),  735  742  (2005). 

Idora,  X.,  K.  Sfustry,  and  D.  E.  Goldberg,  The  compact  classifier  system:  Motivation,  analysis 
and  first  results.  Proceedings  of  the  2005  Congress  on  Evolutionary  Computation,  1,  596  603, 
(2005). 

Llora,  X.,  K.  Sastry,  D.  E.  Goldberg,  The  Compaet  Classifier  System:  Motivation,  Analysis,  and 
First  Results.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference  (GECCO 
2005)  [poster],  1993  1994  (2005). 

Lloia,  X.,  K.  Sastry,  D.  E.  Goldberg,  A.  Gupta,  and  L.  Lakslnni,  Combating  User  Fatigue  in  iCJAs: 
Partial  Ordering,  Support  Veetor  Maehines,  and  Synthetie  Fitness.  Proceedings  of  the  Genetic 
and  Evolutionary  Computation  Conference  (GECCO  2005),  1363  1370  (2005). 

Matsumura,  N.,  D.  E.  Goldberg,  and  X.  Llora,  Mining  Social  Networks  in  Message  Boards.  Pro- 
ccedings  of  the  Symposium  on  Conversational  Informatics  for  Supporting  Social  Intelligence, 
18  27  (2005). 

McClay,  L  and  D.  E.  Goldberg,  Efficient  Genetie  Algorithms  using  Diseretization  Scheduling. 
Evolutionary  Computation,  13(3),  353-385  (2005). 

Pelikan,  M.  Hierarchical  Bayesian  optimization  algorithm:  Toward  a  new  generation  of  evolution¬ 
ary  algorithms.  Berlin:  Springer- Verlag  (2005). 

Pelikan,  M.,  Sastry,  K.  Goldberg,  D.  E.  (2005).  Multiobjeetive  hBOA,  elustering,  and  scalability. 
Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference  (GECCO-2005).  663  670 
(2005). 

Qurin,  A.,  J.  Korezak,  M.  V.  Butz,  and  D.  E.  Goldberg,  Analysis  and  Evaluation  of  Learning 
Classifier  Systems  Applied  to  Hyperspectral  Image  Classification.  Proceedings  of  the  Fifth  In- 
teimational  Conference  on  Intelligent  Systems  Design  and  Applications,  280-285  (2005). 

Sastry,  K.,  M.  Pelilam,  D.  E.  Goldberg,  Limits  of  sealability  of  multiobjeetive  estimation  of  dis¬ 
tribution  algorithms.  Proceedings  of  the  2005  Congress  on  Evolutionai'y  Computation.  3,  2217 
2224,  (2005). 
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Sastry,  K.,  H.  A.  Abbass,  D.  E.  Goldberg,  and  D.  D.  Johnson,  Sub-structural  Niching  in  Estimation 
of  Distribution  Algorithms.  Proceedings  of  the  Genetic  and  Evolutionar'y  Computation  Confer¬ 
ence  (GECCO  2005),  671  678  (2005).  [Best  paper  award  noiniiicc,  Estimation  of  Distribution 
Algorithms  track]. 

Sastry,  K.,  D.  D.  Johnson,  D.  E.  Goldberg,  and  P.  Bclloii,  Genetic  Programming  for  Multi- 
Timescale  Modeling:  A  Proof-of-Principlc  Study.  Physics  Review  B,  72(8),  085438,  (2005). 

Tsutsui,  S..  M.  Pelikan,  and  A.  Ghosh,  Effect  of  local  search  on  edge  histogram  based  sampling 
algorithms  for  permutation  problems.  Proceedings  of  the  Sixth  Metaheuristics  International 
Conference  (MIC  2005),  865-872  (2005). 

Tsutsui,  S.,  M.  Pelikan,  and  A.  Ghosh,  Performance  of  aggregation  pheromone  system  on  uniiuodal 
and  multimodal  problems.  IEEE  Congress  on  Evolutionary  Computation  (CEC-2005),  880  887 
(2005). 

Tsutsui,  S.,  M.  Pelikan,  and  D.  E.  Goldberg.  Probabilistic  Model-building  Genetic  Algorithms 
using  Histogram  Models  in  Continuous  Domain.  Journal  of  the  Information  Processing  So(‘ictv 
of  Japan  (in  press). 

Yassinc,  A.,  D.  E.  Goldberg,  and  T.-L.  Yu,  Simple  Models  of  Hierarchical  Organizations.  Proceed¬ 
ings  of  the  Academy  of  Management,  (2005). 

Yu,  T.-L.,  K.  Sastry,  and  D.  E.  Goldberg,  Online  population  size  adjusting  using  noise  and  sub- 
structural  measurements.  Proceedings  of  the  2005  Congress  on  Evolutionary  Computation  Con¬ 
ference.  3,  2491-2498, (2005). 

Yu,  T.-L.,  K,  Sastry,  and  D.  E.  Goldberg,  Linkage  Learning,  Overlapping  Building  Blocks,  and  a 
Systematic  Strategy  for  Scalable  Recombination.  Proceedings  of  the  Genetic  and  Evolutionary 
Computation  Conference  (GECCO  2005),  1217  1224  (2005). 

5  Publications  for  2006 

Published 

Alias,  F.  ,  X.  Llora,  L.  Formiga,  K.  Sastry,  and  D.  E.  Goldberg,  Efficient  interactive  weight  tuning 
for  TTS  synthesis:  Reducing  user  fatigue  by  improving  user  consistency.  IEEE  Intcmafumal 
Conference  on  Acoustics,  Speech,  and  Signal  Processing  (ICASSP  2006),  1,  865-868,  (2006). 

Butz,  M.V.  and  M.  Pelikan,  Studying  XCS/BOA  Learning  in  Boolean  Functions:  Structure  Ent  od- 
iiig  and  Random  Boolean  Functions.  Proceedings  of  the  Genetic  and  Evolutionar'i/  Computation 
Conference  (GECCO  2006),  1449-1456  (2006). 

Butz,  M.V.,  M.  Pelikan,  X.  Llora,  and  D.  E.  Goldberg,  Automated  Global  Structure  Extraction  For 
Effective  Local  Building  Block  Processing  in  XCS.  Evolutionary  Computation,  14(3),  345  380 
(2006). 

Goldberg,  D.  E.,  The  Entrepreneurial  Engineer.  New  York,  NY:  Wiley  (2006). 

Harik,  G.  R.,  F.  G.  Lobo,  and  K.  Sastry,  Linkage  Learning  via  Probabilistic  Modeling  in  the 
ECGA.  In  Pelikan,  M.,  Sastry,  K.,  Caritu-Paz,  E.  (Eds.),  Scalable  Optimization  via  Probabilistic 
Modeling:  From  Algorithms  to  Applications  (pp  39-61).  Berlin:  Springer  (2006). 

Lanzi,  P.  L.,  D.  Loiacoiio,  S.  W.  Wilson,  and  D.  E.  Goldberg,  Classifier  Prediction  Based  on  Tile 
Coding.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference  (GECCO  2006), 
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1497-1504  (2006).  [Best  paper  award,  Learning  Classifier  Systems  and  other  Genetics-Ba^sed 
Machine  Learning  track]. 

Larizi,  P.  L.,  D.  Loiaeono,  S.  W.  Wilson,  and  D.  E.  Goldberg,  Prediction  Update  Algorithms  for 
XCSF:  RLS,  Kalman  Filter,  and  Gain  Adaptation.  Proceedings  of  the  Genetic  and  Evolutionarg 
Computation  Conference  (GECCO  2006)^  1505-1512  (2006). 

Lima.  C.F.,  M.  Pelikan,  K.  Sastry,  M.  Butz,  D.  E.  Goldberg,  and  F.  G.  Lobo,  Substructural 
Neighborhoods  for  Local  Search  in  the  Bayesian  Optimization  Algorithm.  Proceedings  of  the 
Parallel  Problem  Solving  from  Nature  (PPSN  IX),  232  241  (2006). 

Llora,  X.,  D.  E.  Goldbc^rg,  Y.  Ohsawa,  N.  Matsmnnra,  Y.  Wasliida,  H.  Tamiira,  M.  Yoshikawa,  M. 
Welge,  L.  Anvil,  D.  Searshmith,  K.  Ohnishi,  and  C.-J.  Chao,  Innovation  and  Creativity  Siipi)ort 
via  Chance  Diseovery,  Genetie  Algorithms,  and  Data  Mining.  New  Mathematics  and  Natural 
Computation,  2(1),  85-100  (2006). 

Llora.  X.,  and  K.  Sastry,  Fast  rule  matehing  for  learning  classifier  systems  via  vector  instructions. 
Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference  (GECCO  2006).  1513 
1520,  (2006). 

Llora,  X.,  K.  Sastry,  F.  Alias,  D.  E.  Goldberg,  and  M.  Welge,  Analyzing  active  interactive  geiu^tic 
algorithms  using  visual  analytics.  Proceedings  of  the  Genetic  and  Evolutionary  Computation 
Conference  (GECCO  2006)  [poster],  1417-1418,  (2006). 

Ocenasek,  J.,  E.  Caiitii-Paz,  M.  Pelikan  and  J.  Schwarz.  Design  of  Parallel  Estimation  of  Distri¬ 
bution  Algorithms.  In  M.  Pelikan,  K.  Sastry,  and  E.  Cantii-Paz  (Eds),  Scalable  Optimization 
via  Probabilistic  Modeling:  From  Algomthms  to  Applications.  Berlin:  Springer  (2006). 

Ondas,  R.,  M.  Pelikan,  and  K.  Sastry,  Genetic  programming,  probabilistic  incremental  program 
evolution,  and  scalability.  In  A.  Tiwari,  J.  Knowles,  E.  Avincri,  K.  Dahal,  and  R.  Roy  (Eds.) 
Applications  of  Soft  Computing:  Recent  Trends.  Berlin:  Springer  (2006). 

Pelikan,  M.  and  D.  E.  Goldberg  (2006).  Hierarchical  Bayesian  Optimization  Algorithm.  In  M. 
Pelikan,  K.  Sastry,  and  E.  Cantu-Paz  (Eds),  Scalable  Optimization  via  Probabilistic  Modeling: 
From,  Algorithms  to  Applications.  Berlin:  Springer  (2006). 

Pelikan,  M.  and  A.  Hartmann  (2006).  Searching  for  Ground  States  of  Ising  Spin  Glasses  with 
Hierarchical  BOA  and  Cluster  Exact  Approximation.  In  M.  Pelikan,  K.  Sastry.  and  E.  Cantu- 
Paz  (Eds),  Scalable  Optimization  via  Probabilistic  Modeling:  From  Algorithms  to  Applications . 
Berlin:  Springer  (2006). 

Pelikan,  M.,  A.  K.  Hartmann,  and  K.  Sastry,  Hierarchical  BOA,  Cluster  Exact  Approximation, 
and  Ising  Spin  Glasses.  Parallel  Problem  Solving  from  Nature  (PPSN  IX),  122  131  (2006). 

Pelikan,  M.,  K.  Sastry,  M.  V.  Butz,  D.  E.  Goldberg,  Hierarchical  BOA  on  random  dcconii)os- 
ablc  problems.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference  (GECCO 
2006)  [poster],  431-432,  (2006). 

Pelikan,  M.,  K.  Sastry,  M.  V.  Butz,  and  D.  E.  Goldberg,  Performance  of  Evolutionary  Algorithms 
on  Random  Decomposable  Problems.  Parallel  Problem  Solving  from  Nature  (PPSN  IX),  788 
797  (2006). 

Pelikan,  M.,  K.  Scistry,  E.  Cantu-Paz,  (Eds).  Scalable  Optimization  via  Probabilistic  Modeling: 
From  Algorithms  to  Applications,  Berlin:  Springer  (2006). 

Pelikan,  M.,  K.  Sastry,  and  D.  E.  Goldberg.  Multiobjectivc  Estimation  of  Distribution  Algorithms. 
In  M.  Pelikan.  K.  Sastry,  and  E.  Cantii-Paz  (Eds),  Scalable  Optimization  via  Probabilistic  Mod¬ 
eling:  From  Algorithms  to  Applications  (pp  223-248).  Berlin:  Springer  (2006). 
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Pclikan,  M.,  K.  Sastry,  and  D.  E.  Goldberg,  Sporadic  Model  Building  for  Efficiency  Enlianceinent 
of  Hierarchical  BOA.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference 
(GECCO  2006),  405-412  (2006). 

Santarelli  S.,  T.-L.  Yu,  D.  E.  Goldberg,  E.  Altshuler  E.,  T.  O’Donnell,  H.  Southall,  and  R.  Mail- 
loux,  Military  Antenna  Design  Using  Simple  and  Competent  Genetic  Algorithms.  Mathematical 
and  Computer  Modeling,  43,  990-1022  (2006). 

Sastry,  K.,  D.D.  Johnson,  A.  L.  Thompson,  D.  E.  Goldberg,  T.  J.  Martinez,  J.  Leiding,  and  J. 
Owens,  Multiobjective  genetic  algorithms  for  multiscaling  excited  state  direct  dynamics  in  pho¬ 
tochemistry.  Proceedings  of  the  Genetic  and  Evolutionai'y  Computation  Conference  (GECCO 
2006).  1745-1752,  (2006).  [Best  paper  award  in  Real  World  Applications  track]  [Silver  “Hu- 
mies”  award  at  the  Human  Competitive  Results  Competition]. 

Sastry,  K.,  D.  E.  Goldberg,  G.  Kendall,  Genetic  algorithms:  A  tutorial.  In  E.  Burke,  and  G. 
Kendall  (Eds),  Introductoi'y  Tutorials  in  Optimization,  Search  and  Decision  Support  Method¬ 
ologies.  Berlin:  Springer  (2006). 

Sastry,  K.,  C.  F.  Lima,  and  D.  E.  Goldberg,  Evaluation  relaxation  using  substructural  information 
and  linear  estimation.  Proceedings  of  the  Genetic  and  Evolutionauj  Computation  Conference 
(GECCO  2006).  419-426,  (2006). 

Sastry,  K.,  M.  Pelikan,  and  D.  E.  Goldberg  (2006).  Efficiency  Enhancement  of  Estimation  of  Dis¬ 
tribution  Algorithms.  In  M.  Pelikan,  K.  Sastry,  and  E.  Cantii-Paz  (Eds),  Scalable  Optimization 
via  Probabilistic  Modeling:  From  Algorithms  to  Applications  (pp  161-185).  Berlin:  Springer 
(2006). 

Sastry,  K.,  P.  Winward,  D.  E.  Goldberg,  and  C.  F.  Lima,  Fluctuating  crosstalk  as  a  source  of 
deterministic  noise  and  its  effects  on  GA  scalability.  Applications  of  Evolutionamj  Comput¬ 
ing  EvoWorkshops2006:  EvoBIO,  EvoCOMNET,  EvoHOT,  EvoIASP,  Evointeraction.  Evo- 
MUSART,  EvoSTOCK,  740-751,  (2006). 

Tsutsui,  S.,  M.  Pelikan,  and  A.  Ghosh.  Edge  Histogram  Based  Sampling  with  Local  Search  for 
Solving  Permutation  Problems,  The  International  Journal  of  Hybrid  Intelligent  Systems  3(1), 
11  22,  (2006). 

Yu,  T.-L.,  and  D.  E.  Goldberg,  Conquering  Hierarchical  Difficulty  by  Explicit  Chunking:  Chromo¬ 
some  Compression.  Proceedings  of  the  2006  Genetic  and  Evolutionai'y  Computation  Confeiy  nee . 
1385-1392  (2006). 

Yu,  T.-L.,  S.  Santarelli,  and  D.  E.  Goldberg,  Military  Antenna  Design  Using  Simple  Genetic 
Algorithm  and  liBOA.  In  M.  Pelikan,  K.  Sastry,  and  E.  Cantii-Paz  (Eds),  Scalable  Optimization 
via  Probabilistic  Modeling:  From  Algorithms  to  Applications.  Berlin:  Springer  (2006). 

Yu,  T.-L.,  A.  Yassine,  and  D.  E.  Goldberg,  Double  Duty:  Genetic  Algorithms  for  Organizational 
Design  and  Genetic  Algorithms  Inspired  by  Organizational  Theory.  In  J.-P.  Reimard  (Ed.), 
Handbook  of  Nature  Inspired  Computing  for  Economy  and  Management,  (Chapter  28)  Hershev, 
PA:  Idea  Group  Reference  (2006). 

6  Publications  for  2007 

Submitted 

Chen,  Y.-p.,  T.-L.  Yu,  K.  Sastry,  and  D.  E  Goldberg,  A  Survey  of  Linkage  Learning  Techniques 
in  Genetic  and  Evolutionary  Algorithms.  IEEE  Transactions  on  Evolutionamj  Computation 
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(2007). 

Goldberg,  D.  E.,  A.  Yassinc,  and  T.-L.  Yu,  Decision,  Execution  and  Team  Si7.e:  Insights  froiii 
Simple  Quantitative  Models.  IEEE  Transactions  on  Management  (2007). 

Hausehild,  M.,  M.  Pelikan,  C,  F,  Lima,  and  K.  Sastry,  Analyzing  Probabilistic  Models  in  Hier¬ 
archical  BOA  on  Traps  and  Spin  Glasses.  IEEE  Transactions  on  Evolntionanf  Com.p\itation, 
IEEE  Press. 

Pelikan,  M.,  K.  Sastry,  M.  V.  Butz,  and  D.  E.  Goldberg,  Genetic  and  evolutionary  algorithms  on 
randoni  additivcly  decomposable  problems.  Evolutionary  Computation  Journal,  (2007). 

Sastry,  K.,  M.  Pelikan,  and  D.  E.  Goldberg,  Efficiency  Enhancement  of  Genetic  Algorithms  by 
Building  an  Internal  Probabilistic  Model  of  Fitness.  Evolutionary  Computation  Journal  (2007). 

Published 

Bacardit,  J.  and  M.  V.  Butz,  Data  Mining  in  Learning  Classifier  Systems:  Comparing  XCS  with 
GAssist.  In  T.  Kovacs,  X.  Llora,  K.  Takadama,  P.  L.  Lanzi,  W.  Stolzmann,  and  S.  \\^  Wilson 
(Eds.)  Learning  Classifier  Systems,  282-290.  Springer.  (2007) 

Bacardit,  J.,  D.  E.  Goldberg,  and  M.  V.  Butz,  Improving  the  Performance  of  a  Pittsburgh  Learning 
Classifier  System  Using  a  Default  Rule.  In  T.  Kovacs,  X.  Llora,  K.  Takadama,  P.  L.  Lanzi,  W. 
Stolzmann,  and  S.  W.  Wilson  (Eds.)  Learning  Classifier  Systems,  291  307.  Springer.  (2007). 

Bacardit,  J.,  M.  Stout,  Hirst,  J.D.,  Sastry,  K.,  Llora,  X.,  and  N.  Krasnogor,  Automated  alphabet 
reduction  method  with  evolutionary  algorithms  for  protein  structure  prediction.  Proceedings  of 
the  Genetic  and  Evolutionary  Computation  Conference  (GECCO  2007),  346-353,  (2007). 

Butz,  M.  V.,  D.  E.  Goldberg,  and  P.  L.  Lanzi,  Effect  of  Pure  Error-Based  Fitness  in  XCS.  In  T. 
Kovacs,  X.  Llora,  K.  Takadama,  P.  L.  Lanzi,  W.  Stolzmann  104-114,  and  S.  W.  Wilson  (Eds.) 
Learning  Classifier  Systems,  104-114.  Springer.  (2007). 

Butz,  M.  V.,  D.  E.  Goldberg,  P.  L.  Lanzi,  and  K.  Sastry,  Problem  Solution  Sustenance  in  XCS: 
Markov  Chain  Analysis  of  Niche  Support  Distributions  and  Consequent  Computational  Com¬ 
plexity.  Genetic  Programming  and  Evolvable  Machines,  8,  5  37.  (2007). 

Goldberg,  D.  E.,  K.  Sastry,  and  X.  Llora,  Toward  routine  billion- variable  optimization  using 
genetie  algorithms.  Complexity ,  12(3),  27  29  (2007). 

Hausehild,  M,  M.  Pelikan,  C.  F.  Lima,  and  K.  Sastry,  Analyzing  Probabilistic  Models  in  Hierarchi¬ 
cal  BOA  on  Ti'aps  and  Spin  Glasses.  Proceedings  of  the  Genetic  and  Evolutionary  Computation 
Conference  (GECCO-2007).  523-530,  (2007). 

Lanzi,  P.-L.,  D.  Loiacono,  S.  W.  Wilson,  and  D.  E.  Goldberg,  Generalization  in  the  XCSF  Classifier 
System:  Analysis,  Improvement,  and  Extension.  Evolutionary  Computation,  15(2),  133  168, 
(2007). 

Lima,  C.  F.,  M.  Pelikan,  D.  E.  Goldberg,  F.  G.  Lobo,  K.  Sastry,  M.  Hausehild,  Influence  of 
Selection  and  Replacement  Strategies  on  Linkage  Learning  in  BOA.  Proceedings  of  the  2007 
IEEE  Congress  on  Evolutionary  Computation,  1083  1090.  IEEE  Press.  (2007). 

Llora,  X.,  K.  Sastry,  and  D.  E.  Goldberg,  Binary  Rule  Encoding  Schemes:  A  Study  Using  the 
Compact  Classifier  System.  In  XCS.  In  T.  Kovacs,  X.  Llora,  K.  Takadama,  P.  L.  Lanzi,  W. 
Stolzmann,  and  S.  W.  Wilson  (Eds.)  Learning  Classifier  Systems,  40-58.  Springer.  (2007). 
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Llora.  X.,  K.  Sastry,  D.  E.  Goldberg,  and  L.  de  la  Ossa,  The  x-ary  extended  compact  cla.ssihei 
system:  Linkage  learning  in  Pittsburgh  LCS.  In  T.  Kovaes,  X.  Llora,  and  K.  Takadama  (Eds.  ), 
Advances  at  the  frontier  of  LCS.  Berlin:  Springer,  (2007). 

Llora,  X.,  K.  Sastry,  T.-L.  Yu,  and  D.  E.  Goldberg,  Do  not  iiiateh,  Inherit:  Fitness  surrogates 
for  genet ies- based  maehine  learning  teehiiiqiies.  Proceedings  of  the  Genetic  and  Evolntionarg 
Computation  Conference  (GECCO  2007).  1798-1805,  (2007). 

Llora,  X.,  N.  1.  Yasui,  M.  Welge  and  D.  E.  Goldberg,  Human- Centered  Analysis  and  Visualization 
Tools  for  the  Blogosphere.  Proceedings  of  the  2007  Digital  Humanities  Conference.^  127.  (2007). 

Llora,  X.,  N.  1.  Ycisui,  and  D.  E.  Goldberg,  Analyzing  trends  in  the  blogosphere  using  hinnaii- 
eeiitered  analysis  and  visualization  tools.  Proceedings  of  the  International  Conference  on  IVV- 
blogs  and  Social  Mining  (ICWSM  2007)  285-286  (2007). 

Lobo,  F.  G.,  and  C.  F.  Lima,  Adaptive  Population  Sizing  Sehemes  in  Genetie  Algorithms.  In  F. 
G.  Lobo  et  al.  (Eds.),  Parameter  Setting  in  Evolutionary  Algorithms^  Studies  in  Com})utational 
Iiitelligenee  Series,  Springer.  (2007). 

Lobo,  F.  G.,  C.  F.  Lima,  and  Z.  Miehalewiez  (Eds.),  Parameter  Setting  in  Evolutionary  Algoiithms. 
Studies  in  Computational  Iiitelligenee  Series,  Springer.  (2007). 

Matsumnra,  N.,  D.  E.  Goldberg,  and  X.  Llora,  Communieation  Gap  Maiiageinent  for  Fertile 
Community.  Journal  of  Soft  Computing^  11(8),  791  798,  (2007). 

Miiiqiang,  L.,  D.  E.  Goldberg,  K.  Sastry,  and  T.-L.  Yu,  Real-eoded  ECGA  for  solving  decompos¬ 
able  real- valued  optimization  problems.  Proceedings  of  the  Genetic  and  Evolutionai'ij  Compu¬ 
tation  Conference  (GECCO  2007),  2194-2201,  (2007). 

Miiiqiang,  L.,  D.  E.  Goldberg,  K.  Sastry,  and  T.-L.  Yu,  Performaiiee  analyses  of  factorization 
based  on  Gaussian  PDF  in  RECGA.  Proceedings  of  the  Genetic  and  Evolutionary  Computation 
Conference  (GECCO  2007),  362  369,  (2007). 

Orriols-Puig,  A.,  D.  E.  Goldberg,  K.  Sastry,  and  E.  Beriiado-Mansilla,  Modeling  XCS  in  class 
imbalances:  Population  sizing  and  parameter  settings.  Proceedings  of  the  Genetic  and  Evolu- 
tionanj  Computation  Conference  (GECCO  2007),  1838-1845,  (2007). 

Orriols-Puig,  A.,  K.  Sastry,  P.  L.  Lanzi,  D.  E.  Goldberg,  and  E.  Bernado-Maiisilla,  MocUding 
seleetion  pressure  in  XCS  for  proportionate  and  tournament  seleetion.  Proceedings  of  the  Genetic 
and  Evolutionary  Computation  Conference  (GECCO  2007),  1846-1853,  (2007). 

Pelikan,  M.,  A.  K.  Hartmann,  Obtaining  Ground  States  of  Ising  Spin  Glasses  via  Optimizing 
Bonds  Instead  of  Spins.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference 
(GECCO-2007)  [poster],  628,  (2007). 

Pelikan,  M.,  A.  Hartmann,  and  T.-K.  Lin,  Parameter- less  Hierarchical  Bayesian  Optimization 
Algorithm.  In  F.  G.  Lobo,  C.  F.  Lima,  and  Z.  Miehalewiez  (Eds.),  Parameter  Setting  in  Evo¬ 
lutionary  Algorithms.  Berlin:  Springer  (2007). 

Pelikan,  M.,  R.  Kalapala,  and  A.  K.  Hartmann,  Hybrid  Evolutionary  Algorithins  on  Miniiiunn 
Vertex  Cover  for  Random  Graphs.  Proceedings  of  the  Genetic  and  Evolutionary  Computation 
Conference  (GECCO-2007),  547-554,  (2007). 

Pelikan,  M.,  and  J.  D.  Laury,  Jr.  Order  or  Not:  Docs  Parallelization  of  Model  Building  in  liBOA 
AOect  Its  Scalability?  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference 
(GECCO-2007),  555-561,  (2007). 
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Polikan,  M.,  S.  Tsutsui,  and  R.  Kalapala,  Dependency  Trees,  Permutations,  and  Quadratic  Assign¬ 
ment  Problem.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference  (GECCO- 
2007)  [poster],  629,  (2007). 

Sastry,  K.,  and  D.  E.  Goldberg,  Let’s  get  ready  to  rumble  redux:  Crossover  versus  iiiutatioii 
head  to  head  on  exponentially  sealed  problems.  Proceedings  of  the  Genetic  and  Evolutionary 
Computation  Conference  (GECCO  2007),  1380-1387,  (2007). 

Sastry,  K.,  D.  E.  Goldberg,  and  X.  Llora,  Towards  billion  bit  optimization  via  parallel  cstiinatioii 
of  distribution  algorithm.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Confer¬ 
ence  (GECCO  2007),  577  584,  (2007).  [Best  paper  award  winner,  Estimation  of  Distri])utioii 
Algorithms  track]. 

Sastry,  K.,  D.  D.  Johnson,  and  D.  E.  Goldberg,  Scalability  of  a  hybrid  extended  compact  genetic 
algorithm  for  ground  state  optimization  of  clusters.  Materials  and  Manufacturing  Processes, 
22(5),  570-576,  (2007). 

Sastry,  K.,  D.  D.  Johnson,  A.  L.  Thompson,  D.  E.  Goldberg,  T.  J.  Martinez,  T.  J.,  J.  Leidiiig, 
and  J.  Owens,  Optimization  of  Scmicmpirical  Quantum  Chemistry  Methods  via  Multiobjective 
Genetic  Algorithms:  Accurate  Photochemistry  for  Larger  Molecules  and  Longer  Time  Seales 
Materials  and  Manufacturing  Processes,  22(5),  553-561,  (2007). 

Sastry,  K.,  M.  Pelikan,  and  D.  E.  Goldberg,  Analysis  of  Ideal  Recombination  on  Random  De¬ 
composable  Problems.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Conference 
(GECCO-2007),  1388-1395,  (2007).  [Best  paper  award  nominee.  Genetic  Algorithms  track]. 

Ueda,  T.,  N.  I.  Yasui,  X.  Llora,  K.  Sastry,  and  D.  E.  Goldberg,  Discovering  Building  Blocks  for 
Human  Based  Genetic  Algorithms.  Artificial  Neural  Networks  In  Engineering  (ANNIE-2007). 

Yasui,  N.  I.,  X.  Llora,  D.  E.  Goldberg,  Y.  Washida,  and  H.  Tainura,  Delineating  To])ic  and 
Discussant  Tiansitions  in  Online  Collaborative  Environincnts.  Proceedings  of  the  International 
Conference  on  Enterprise  Information  Systems  (ICEIS),  14  21,  (2007). 

Yu,  T.-L.,  K.  Sastry,  and  D.  E.  Goldberg,  Population  sizing  to  go:  Online  adaptation  using 
noise  and  substructural  incasurcmcnt.  In  F.  G.  Lobo,  C.  F.  Lima,  and  Z.  Michalewicz  (Eds.), 
Parameter  Settings  in  Evolutionary  Algorithms.  Berlin:  Springer  (2007). 

Yu,  T.-L.,  K.  Sastry,  D.  E.  Goldberg,  and  M.  Pelikan,  Population  sizing  for  cut  ropy- based  model 
building  in  genetic  algorithms.  Proceedings  of  the  Genetic  and  Evolutionary  Computation  Con¬ 
ference  (GECCO  2007),  60 T  608,  (2007).  [Best  paper  award  nominee,  Estimation  of  Distribu¬ 
tion  Algorithms  track]. 

Yu,  T.-L.,  A.  Yassinc,  and  D.  E.  Goldberg.  An  Information  Theoretic  Method  for  Develoj)iiig 
Modular  Architectures  Using  Genetic  Algorithms.  Research  in  Engineering  Design,  18(2),  91 
109,  (2007). 

7  Publications  for  2008 

Submitted 

Csefalvayova,  L.,  Pelikan,  M.,  Kralj  Cigic,  I.,  Kolar,  J.,  M.  Strlic,  Use  of  genetic  algorithms  with 
multivariate  regression  for  determination  of  gelatine  in  historical  papers  from  FT-IR  and  MR 
spectral  data.  Analytical  and  Bioanalytical  Chemistry. 
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Hamnicl,  M.,  Yu,  Y..  Mahaiicy,  B.  L.,  Cai,  B.,  Yc,  R.,  Phipps,  B.M.,  Pclikaii,  M.,  Rambo,  R.P., 
Hura,  G.L..  Lccs-Millcr,  S.  R,  J.  A.  Taincr,  Structural  Insights  into  the  Ku70/Ku80/DNA-PKcs 
Complex  and  Consequences  for  Nonhomologous  End  Joining.  Molecular  Cell. 

Hauschild,  M.,  M.  Pelikan,  K.  Sastry,  D.  E.  Coldbcrg,  Using  Previous  Models  to  Bias  Structural 
Learning  in  the  Hierarchical  BOA.  Evolutionary  Computation.,  MIT  Press. 

Pelikan,  M.,  Hammcl,  M.,  C.  L.  Hura,  Structure  and  Flexibility  within  Proteins  as  Identified 
Through  Small  Angle  X-ray  Scattering.  General  Physiology  and  Biophysics. 

Published 

Brownlee,  S.,  J.  McCall,  M.  Pelikan,  S.  Shakya,  An  Application  of  a  Multivariate  Estimation 
of  Distribution  Algorithm  to  Cancer  Chemotherapy.  Genetic  and  Evolutionary  Coinputation 
Conference  (GECCO-2008),  pp.  463-464,  ACM  Press. 

Blitz,  M.  V.,  P.-L.  Lanzi,  X.  Llora,  and  D.  Loiacono,  An  Analysis  of  Matching  in  Learning  Classifier 
Systems.  Genetic  and  Evolutionary  Computation  Conference  (GECCO-200S),  pp.  1349-1356, 
ACM  Press. 

Blitz,  M.  V.,  P.  Stalph,  and  P.-L.  Lanzi,  Self-Adaptive  Mutation  in  XCSF.  Genetic  and  Eeola- 
tionary  Computation  Conference  (GECCO-2008)^  pp.  1365-1372,  ACM  Press. 

Duque,  T.  S.  P.  C.,  D.  E.  Coldbcrg,  and  K.  Sastry,  Enhancing  the  Efficiency  of  ECCA.  Parallel 
Problem  Solving  from  Nature  (PPSN  X)y  pp.  165-174,  Springer. 

Duque,  T.  S.  P.  C.,  D.  E.  Coldbcrg,  and  K.  Sastry,  Improving  the  Efficiem  y  of  the  Extendi'cl 
Compact  Cciictic  Algorithm.  Genetic  and  Evolutionary  Computation  Conference  (GECCO- 
2008),  pp.  467-468,  ACM  Press. 

Fernandes,  C.  M.,  C.  F.  Lima,  and  A.  C.  Rosa,  UMDAs  for  Dynamic  Optimization  Problems. 
Genetic  and  Evolutionary  Computation  Conference  (GECCO-2008),  pp.  399-406,  ACM  Press. 

Hauschild,  M.,  and  M.  Pelikan,  Enhancing  Efficiency  of  Hierarchical  BOA  Via  Distance-Based 
Model  Restrictions.  Parallel  Problem  Solving  from  Nature  (PPSN  X),  pp.  417-427,  Springer. 

Hauschild,  M.,  M.  Pelikan,  K.  Sastry,  D.  E.  Goldberg,  Using  Previous  Models  to  Bias  Struc¬ 
tural  Learning  in  the  Hierarchical  BOA.  Genetic  and  Evolutionary  Computation  Conference 
(GECCO-2008),  pp.  415-422,  ACM  Press. 

Howard,  G.  D.,  L.  Bull,  and  P.-L.  Lanzi,  Self-Adaptive  Constriietivism  in  Neural  XCS  and 
XCSF.  Genetic  and  Evolutionary  Computation  Conference  (GECCO-2008),  pp.  1389-1396, 
ACM  Press. 

Lanzi,  R  L.,  Nichetti,  L.,  Sastry,  K.,  Voltini,  D.,  D.  E.  Goldberg,  Real-Coded  Extended  Compact 
Genetic  Algorithm  Based  on  Mixtures  of  Models.  In  Chcii,  Y.-P.  and  Liiii  M.-H.  (Eds.)  Linkage 
in  Evolutionary  Computation,  pp.  335-358,  Springer. 

Li,  M,  Goldberg,  D.  E.,  Sastry,  K.,  and  T.-L.  Yu,  Real-Coded  ECGA  for  Solving  Decompos¬ 
able  Real- Valued  Optimization  Problems.  In  Chen,  Y.-P.  and  Lim  M.-H.  (Eds.)  Linkage  in 
Evolutionary  Computation,  pp.  61-86,  Springer. 

Lima,  C.  F.,  F.  G.  Lobo,  and  M.  Pelikan.  From  Mating  Pool  Distributions  to  Model  Overfitiing. 
Genetic,  and  Evolutionary  Computation  Conference  (GECCO-2008),  pp.  431-438,  ACM  Press. 

Lima,  C.  F.,  C.  M.  Fernandes,  and  F.  G.  Lobo.  Investigating  Restricted  Tournament  Replacement 
in  ECGA  for  Non-Stationary  Environments.  Genetic  and  Evolutionary  Computation  Conference 
(GECCO-2008),  pp.  439-446,  ACM  Press. 
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Lima,  C.  F.,  Pclikaii,  M.,  Goldberg,  D.  E.,  Lobo,  F.  G.,  Sastry,  K.,  M.  Hauscliild,  Linkage  Leaniiiig 
Accuracy  in  the  Bayesian  Optimization  Algorithm.  Linkage  in  Evolutionary  Computation,  pp. 
87-107,  Springer. 

Llora,  X.,  N.  1.  Yasiii,  and  D.  E.  Goldberg,  Graph-Theoretic  Measure  for  Active  iGAs:  Interaction 
Sizing  and  Parallel  Evaluation  Ensemble.  Genetic  and  Evolutionary  Computation  Conference 
(GECCO-2008),  Chen,  Y.-P.  and  Lim  M.-H.  (editors),  pp.  985-992,  ACM  Press. 

Loiacoiio,  D.,  and  P.-L.  Lanzi,  Reeursive  Least  Squares  and  Quadratic  Prediction  in  Continuous 
Multistcp  Problems.  Genetic  and  Evolutionary  Computation  Conference  (GECCO-2008).  pp. 
1985-1992,  ACM  Press. 

Mengshoel,  O.  J.,  D.  E.  Goldberg,  The  Crowding  Approaeh  to  Niehing  in  Genetic  Algorithms. 
Evolutionary  Computation  16(3),  pp.  315-354. 

Pelikan,  M.,  Analysis  of  Estimation  of  Distribution  Algorithms  and  Genetic  Algorithms  on  NK 
Landscapes.  Genetic  and  Evolutionary  Computation  Conference  (GECCO-2008),  pp.  1033- 
1040,  ACxM  Press. 

Pelikan,  M.,  Katzgraber,  H.,  Kobe,  S.,  Finding  Ground  States  of  Sherrington- Kirkpatrick  S])iii 
Glasses  with  Hierarchical  BOA  and  Genetic  Algorithms.  Genetic  and  Evolutionary  Computation 
Conference  (CECCO-2008),  pp.  447-454,  ACM  Press. 

Pelikan,  M.,  Sastry,  K.,  Goldberg,  D.E,  iBOA:  The  Incremental  Bayesian  Optimization  Algorithm. 
Genetic  and  Evolutionary  Computation  Conference  (CECCO-2008),  pp.  455-462,  ACM  Press. 

Pelikan,  M.,  K.  Sastry,  and  D.  E.  Goldberg,  Sporadic  Model  Building  for  Efficiency  Enhaiicenient 
of  Hierarchical  BOA.  Genetic  Programming  and  Evolvable  Machines^  9(l)i  PP-  53-84. 

Saruwataii,  S.,  X.  Lloni,  N.  1.  Yasui,  H.  Tamura,  K.  Sastry,  and  D.  E.  Goldberg,  Speeding  Online 
Synthesis  via  Enforced  Sclccto-Rccoinbinatioii.  Genetic  and  Evolutionar'y  Computation  Confer¬ 
ence  (CECCO-2008),  pp.  1635-1642,  ACM  Press. 

Sato,  Y.,  D.  E.  Goldberg,  and  K.  Sastry,  Improving  Small  Population  Performanee  under  Noise 
with  Viral  Infection  T  Tropism,  Genetic  and  Evolutionary  Computation  Conference  (CECCO- 
2008),  pp.  1143-1144,  ACM  Press. 

Vallini,  R.  M.  M.,  D.  E.  Goldberg,  X.  Llora,  T.  S.  P.  C.  Diique,  and  A.  C.  P.-L.  F.  Carvalho,  A 
New  Approach  for  Multi-Label  Classification  based  on  Default  Hierarchies  and  Organizational 
Learning.  Genetic  and  Evolutionary  Computation  Conference  (CECCO-2()08),  pp.  2017-2022. 
ACM  Press. 

Yasui,  N.  L,  Sariiwatari,  S.,  Llora,  X.,  and  D.  E.  Goldberg,  Facilitation  Support  for  On-Line  Focus 
Group  Discussions  by  Message  Feature  Map.  Proceedings  of  the  Tenth  International  Conference 
on  Enterprise  Information  Systems^  pp.  563-566. 


8  Publications  for  2009 

Submitted 

Duque,  T.  S.  P.  C.,  D.  E.  Goldberg,  ClustcrMI:  Building  Probabilistic  Models  using  Hierarchi¬ 
cal  Clustering  and  IMutual  Information,  Genetic  and  Evolutionary  Computation  Conference 
(CECCO-2009). 

Hauscliild,  M.,  M.  Pelikan,  Intelligent  Bias  of  Network  Structures  in  the  Hierarchical  BOA,  Genetic 
and  Evolutionary  Computation  Conference  (GECCO-2009). 
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Moreno- Torres,  J.  G.,  Llor,  X.,  D.  E.  Goldberg,  Binaiy  Representation  in  Gene  Expression  Pro¬ 
gramming:  Towards  a  Better  Sealability,  Genetic  and  Evolutionary  Computation  Confvrencv 
(GECCO-2009). 

Pelikan,  M.,  H.  G.  Katzgraber,  Analysis  of  Evolutionary  Algorithms  on  the  One-Dimensional 
Spin  Glass  with  Power-Law  Interaetions,  Genetic  and  Evolutionary  Computation  Conferenev 
(GECCO-2009). 

Pelikan,  M.,  K.  Sastry,  Initial-Population  Bias  in  the  Univariate  Estimation  of  Distribution  Algo¬ 
rithm,  Genetic  and  Evolutionary  Computation  Conference  (GECCO-2009). 

Pelikan,  M.,  Sastry,  K.,  Goldberg,  D.  E.,  Butz,  M.  V.,  M.  Hauschild,  Performanee  of  Evolution¬ 
ary  Algorithms  on  NK  Landseapes  with  Nearest  Neighbor  Interactions  and  Tunable  Overhi]), 
Genetic  and  Evolutionary  Computation  Conference  (GECCO-2009). 

Radetie,  E.,  Pelikan,  M.,  D.  E.  Goldberg,  EfFeets  of  a  Deterministie  Hill  elimber  on  liBOA,  Genetic 
and  Evolutionary  Computation  Conference  (GECCO-2009). 

Vallim,  R.  M.  M.,  Duque,  T.  S.  P.  C.,  Goldberg,  D.,  A.  C.  P.  L.  F.  Carvalho,  The  Multi- lahel 
OCS  with  a  Genetie  Algorithm  for  Rule  Diseovery:  Implementation  and  First  Results,  Genetic 
and  Evolutionary  Computation  Conference  (GECCO-2009). 

Accepted,  In  Press 

Hauschild,  M.,  M.  Pelikan,  K.  Sastry,  and  D.  E.  Goldberg,  Using  Previous  Models  to  Bias  Struc¬ 
tural  Learning  in  the  Hierarchieal  BOA.  IEEE  Transactions  on  Evolutionarij  Computation . 


9  Interactions  and  Transitions 

This  seetion  lists  meeting  partieipatioii,  presentations,  and  transitions. 

Meeting  Participation  and  Presentation 

All  conference  papers  above  represent  presentations  by  Professor  Goldberg,  Professor  Martin  Pe¬ 
likan,  Kumara  Sastry,  their  affiliates,  or  Professor  Goldberg’s  and  Professor  Pelikan's  students. 

Professor  Goldberg  gave  the  following  keynote  speeches: 

From  Optimization  to  Invention  Machine:  The  Genetic  Path  to  Competent  &  Efficient  Computa¬ 
tion  IEEE  International  Conference  on  Image  Processing,  Genoa,  Italy  (2005). 

Little  Models,  Big  Results.  1 8th  Joint  Australian  Conference  on  Artificial  Intelligence,  and  the 
Australian  Conference  on  Artificial  Life,  Sydney,  Australia  (2005). 

Solving  Larger,  Faster,  and  Harder:  The  Incredible  Stony  of  Supermultiplicative  Speedups.  Fron¬ 
tiers  of  Computational  Science,  Nagoya,  Japan,  2005. 

Additionally,  Professor  Pelikan  gave  the  following  keynote  speeches  and  tutorials: 

Probabilistic  Model- Building  Genetic  Algorithms  [tutorial].  Genetic  and  Evolutionary  Comimtation 
Conference  (GECCO),  2005,  2006,  2007,  2008. 

Hierarchical  Bayesian  Optimization  Algorithm  [plenary  speech],  WSEAS  International  Conference 
on  Evolutionary  Computing  2005,  Lisbon  (Portugal),  June  16,  2005. 
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Transitions 


liBOA  US  utility  patent  issued.  The  hierarchical  Bayesian  optimization  algorithm  patent,  A 
Method  for  Optimizing  a  Solution  Set,  was  issued  as  US  patent  no.  7,047,169. 

liBOA  licenses  in  the  works.  The  hierarehieal  Bayesian  optimization  algorithm  is  being  niuler 
evaluation  license  for  applications  in  stock  market  decision  making.  Test  results  are  ])roniisiiig 
and  a  deeision  on  a  full  license  of  the  teehnology  is  imminent.  A  license  of  hBOA  to  a  firm 
in  electronic  design  automation  is  in  the  final  stages  of  negotiation. 

Nextumi  releases  ShareThis.  With  venture  eapital  provided  by  IllinoisVentures  and  Blue  Cdiip 
Venture  Capital,  Nextumi  Inc.,  a  web  2.0  startup  company  that  simplifies  sharing  of  photos, 
videos,  urls  and  other  content  between  people  across  different  devices  released  its  first  product 
ShareThis.  Nextumi  licensed  AFOSR  sponsored  competent  GA  research  (patents)  to  help  to 
create  consumer-adaptive  technology. 

Entrepreneurial  engineer  published.  Professor  Goldberg  published  a  new  book,  The  En¬ 
trepreneurial  Engineer  (Wiley,  2006)  for  engineering  students  and  practicing  engineers  to 
help  develop  those  personal,  interpersonal,  and  organizational  skills  necessary  today. 

Scalable  optimization  via  probabilistic  modeling.  Professor  Pelikan,  Kumara  Sastry,  and 
Erick  Cantii-Paz  edited  a  book  Scalable  Optimization  via  Probabilistic  Model  Building  which 
includes  subject  matter  ranging  from  statc-of-thc  art  probabilistic  model-building  algorithms 
to  the  application  of  PMBGAs  on  real-world  problems  from  some  of  the  leading  researchers 
in  the  area. 

Missouri  Estimation  of  Distribution  Algorithms  Laboratory  (MEDAL).  Professor  Pe¬ 
likan  founded  the  Missouri  Estimation  of  Distribution  Algorithms  Laboratory  (MEDAL) 
at  the  Department  of  Mathematics  and  Computer  Science  at  the  University  of  Missouri 
in  St.  Louis.  MEDAL  focuses  on  design,  application,  enhancement  and  dissemina¬ 
tion  of  robust  and  scalable  optimization  methods.  More  information  can  be  found  at 
http : //medal . cs . umsl . edu/. 


10  New  Discoveries,  Inventions,  or  Patent  Disclosures 

Patent  applic-ations  have  been  filed  on  new  discoveries/inventioiis  including: 

•  The  hierarchical  Bayesian  optimization  algorithm. 

•  A  robust  and  scalable  GA,  called  design  structure  matrix  GA,  inspired  from  organizational 
theory. 

•  Collaborative  systems  design  and  innovation  support  over  the  web  using  interactive  GAs. 
human- based  GAs,  and  chance  discovery. 

•  Supcrmultiplicativc  spccdups  via  a  tight  integration  of  probabilistic  models  and  evaluation 
relaxation. 

•  Supcrmultiplicativc  spccdups  via  adaptive  time  continuation,  where  surrogate  and  struc¬ 
tural  models  arc  used  to  adaptively  determine  the  appropriate  choice  bctw'ccn  crossover-  and 
mu t at  ion-doiniiiat cd  search . 


17 


•  Evahiation  relaxation  for  avoiding  user  fatigue  and  user  inconsistency  in  interactive  GAs. 

•  Multiobjcctive  GAs  for  fast  and  accurate  quantum  chemistry  simulations 

•  Efficient  GA  iinplementation  for  solving  hard  problems  with  millions  and  billions  of  variables 

•  Sealable  methods  for  solving  design,  optimization,  and  modeling  problems  of  complex  systems 
with  modularity,  hierarchy,  and  overlap 

Ill  all,  nine  patents  have  been  filed,  with  one  US  patent  issued,  in  connection  with  AF  research  in 
the  recent  past: 

Pclikaii,  M.,  and  D.  E.  Goldberg.  Method  for  Optimizing  a  Solution  Set.  US  patent  #  7,047,169 
B2.  (2006). 

Goldberg,  D.  E.,  K.  Sastry,  C.  F.  Lima,  and  F.  G.  Lobo.  Adaptive  Optimization  Methods.  US 
utility  patent  pending  (2007). 

Goldberg,  D.  E.,  T.-L.  Yu,  and  A.  Yeissine.  Methods  and  Program  Products  for  Optimizing  PivhU  rn 
Clustering.  US  utility  patent  pending  (2004). 

Goldberg.  D.  E.,  M.  Welgc,  and  X.  Llora,  X.  Methods  and  Systems  for  Collaboration.  Decision 
Support,  and  Knowledge  Management.  US  utility  patent  pending  (2004). 

Llora,  X.,  K.  Sastry  and  D.  E.  Goldberg.  Methods  and  Systems  for  Interactive  Computing .  US 
utility  patent  pending  (2007). 

Sastry,  K.,  Pelikan,  M.,  and  D.  E.  Goldberg.  Method  for  Efficient  Solution  Set  Optimization.  L^S 
utility  patent  pending  (2005). 

Sastry,  K.,  A.  L.  Thompson,  D.  D.  Johnson,  D.  E.  Goldberg,  and  T.  J.  Martinez.  Quantum 
Chemistry  Simulations  Using  Optimization  Methods.  US  provisional  patent  pending  (2007). 

Sastry,  K.,  X.  Llora,  and  D.  E.  Goldberg.  A  Method  for  Solving  Large-Scale  Optimization  with 
More  Than  Millions  of  Variables  Quickly,  Reliably,  and  Accurately.  US  provisional  patent  filing 
(2007). 

Yu,  T.-L.,  and  D.  E.  Goldberg.  Using  Genetic  Algorithms,  Dependency  Structure  Matr'-ix,  Sub- 
structural  Chromosome  Compression,  and  Proper  Sequencing  for  Finding  Extrema  of  Pr^oblerus 
with  Hierarchy  and  Overlap.  US  provisional  patent  filing  (2006). 

11  Honors  and  Awards 

NSF  CAREER  award.  Professor  Pelikan  reeeived  NSF  CAREER  Award  (2006  2011)  for  tin- 
project  Design  and  Application  of  Scalable  Hierarchical  Optimization  Algorithms  by  Combin¬ 
ing  Evolutionary  Computation,  Machine  Learning  and  Statistics. 

JSD  Professor.  Professor  Goldberg  was  named  Jerry  S.  Dobrovolny  Distinguished  Professor  in 
Entrepreneurial  Engineering  in  May  2003.  The  investiture  was  held  September  23.  2003. 

ISGEC  Fellow.  Professor  Goldberg  was  named  part  of  the  inaugural  class  of  Senior  Fellows  for 
the  International  Society  for  Genetic  and  Evolutionary  Computation.  (2003). 

Other  Awards.  1985  NSF  Presidential  Young  Investigator.  1995,  Associate,  Center  for  Advanced 
Study  (Illinois).  1996,  Wickenden  Award  (ASEE).  1997,  Gainbrinus  Fellow  (Dortmund). 
NTU  Outstanding  Instructor  Award  (2001-2002). 
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Student  Honors 


GECCO-2006  Best  Paper  Awards.  Two  papers  from  lab  members  won  best  paper  awards  at 
the  2006  Genetie  and  Evolutionary  Computation  eonferenee  organized  by  ACM  SIGEVO. 

Silver  ‘‘Humies”  award,  IlliGAL  teams  entry,  ’’Multiobjective  Genetie  Algorithms  for  Multi¬ 
scaling  Excited- St  ate  Direct  Dynamics  in  Photochemistry,”  was  awarded  the  silver  “Humies’’ 
medal  at  the  human  competitive  results  competition  at  the  2006  Genetic  and  Evolutionary 
Computation  Conference.  The  teams  entry  was  presented  by  Kumara  Sastry.  Other  team 
members  included  Duane  D.  Johnson,  Alexis  L.  Thompson,  David  E.  Goldberg,  Todd  J. 
Martinez,  Jeff  Leidiiig,  and  Jane  Owens. 

GECCO-2007  Best  Paper  Nominations.  Four  papers  from  lab  members  arc  nominated  for 
best  paper  at  the  2007  Genetic  and  Evolutionary  Computation  conference  organized  by  ACM 
SIGEVO.  One  paper  was  awarded. 

Finalist,  Lemelson-Illinois  Prize.  Kumara  Sastry  was  a  finalist  for  $30,000  Lemelson-Illinoi.s 
Prize  for  the  most  inventive  student  at  the  University  of  Illinois. 

Focused  article  of  frontier  research.  Paper  Genetic  programming  for  multi-tiinescale  ino(ivhn(j 
was  chosen  by  the  AIP  editors  as  focused  article  of  frontier  research  in  Virtual  Journal  of 
Naiioscalc  Science  &  Technology,  12(9).  2005 

Two  Bronze  “Humies”  Awards.  Two  projects  from  lab  members  were  awarded  bronze  modal 
in  the  competition  for  the  best  human  competitive  results  Humics  (Human  Competitive 
Results)  at  GECCO-2007. 

GECCO-2008  Best  Paper  Awards.  One  paper  from  lab  members  won  the  best  paj)cr  award 
at  the  2008  Genetic  and  Evolutionary  Computation  conference  organized  by  ACM  SIGEVO. 
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